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ABSTRACT 



The procedure described for evaluati'ig foreign 
language programs is based on the interaction of teaching and 
supervisory personnel, materials (administrative guides and texts) , 
and students. Discussion includes techniques to formulate 
instructional objectives in behavioral terms with specific reference 
to foreign languages, distinguishing between operational objectives 
and procedural statements. Sample objectives illustrating principles 
of language instruction are included. Factors based on such learning 
principles which serve as guides to the activity of the teacher in 
attaining behavioral objectives are listed. Techniques for gathering 
evidence based on pupil performance for use in program evaluation 
through classroom visitation by supervisors are examined. (RL) 
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FCBE3GN LANGUAGE HlOGRAM EVALQATION 
BASED GN A DEFINITiai GF CBJECTIVES 



!• Purpose and Scope 



The purpose of this project is to proilde a guideline or nodel for 
ating a foreign language program regardless of the levels, aatarials, or approadie: 
involved* Evaluation is essential to determine whether or not a program is suc- 
cessful in achieving the goals for vhich it vas established* This has become 
increasingly iiQKartaat in vieir of the public*s current derand for evidence to 
justify tax expenditures for education* 



A program consists of teadiing and siQ>erviso(r 7 personnel, the materials 
(a±dnistrative guidef> and texts), the students, but more important, the inter- 
action of these three elements* The prcblem of determining how effective this 
interaction is at any given point in its development vill be eaQ>lored according 
to criteria deddod the cooperation of the teacher and in the lig^t of 
factors derived from experiments in the psychology of learning* In certain guides 
for evaluating the effectiveness of a program, the enghasis is focused primarily osi 
vhat the teacher does, the techniques he uses, and in connection with a given 
methodology* This, for exaiaple, is reflected in the current efforts in adcro- 
teadiing nov in progress at Sta^ord Ihilversity (Politzer, 1^66)* At best, aoy 
evalnatioin or judpietit passed by supervisoiy personnel on visiting a foreign 
language classroom frequently resolves itself into a discussion of bow the supeov 
visor himself mi^t have handled a specific problem or technique and £rou. a 
purely personal, subjective point of view* A non«<(ubjectlve point of view would 
have sudi characteristics as derive from observable and measurable data idiicfa 
could be agreed iq>Gn and substantiated by the supervisor and the classroom teacherc 
Such data can be gathered during a class session when objectives for each lesson 
are determined in advance and are stated in tenns of terminal student behavior* 

The objective, rather the achievement of the objective, then becomes the focal 
point for discussing classroom practice and ultimately— to the extent that 
achievement is readied— for determing the *7alue of a given program* An excellmit 
example of the application of this perspective at the elementary school level 
is the Behavioral Outcomes Project in the schools of Norwalk, Connecticut, diich 
took place in 1^66-67« (Gerhard, lp6?) 
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Basically an objective is a statement of Instructional goals specifying 
iMch behavioral changes in the learner are sought by the teacher* The teacher 
and supervisor should consider objectives a sine qua non of the foreign language 
program* Far too many of us censider objectives as long-range goals or outcome, 
and as siidi they become Impractical for the daily class sessions* Therefore we 
often tend to pay them mere lip service* The result is that courses of study 
and guidelines frequently contain dieckUstc and evaluative criteria based on, a 
given set of materials and methodolcgy vMch do not fit eveay situation* Conse- 
quently such directives become ineffective* Xhenever materials are changed, the 
guides become obsolete* In an attempt to resolve this problem we would liica to 



2 . 

propose one vsy of consj/dering a soluti^xi idiich entails a nore precise definition 
of instructional goals* This will in turn lead to better coonunication of pro- 
cedures and outcones among foreign language personnel so that the results mesr be 
assessed in a less siibjectiye manner and one idiich is not bound to a particulor 
methodology* 



In this paper^ then^ we hope to present first a discussion of how to 
f emulate' objectives in b^avioral terms with specific reference to foreign 
languages* We shall distinguish betT-Feen operational objectives and procedural 
statements* This will be followed by several examples of objectives pertaining 
to foreign language* Next^ we shall mention certain factors based on learning 
principles which can serve as guides to the activity of the teacher in attaining 
the objectives* F i na l l y^ we would like to suggest how evidence based on pupil 
performance can be gathered through dassroom visitations by which the supervisor 
can correlate his observations with the objectives previously agreed upon with 
the teacher and thereby make the evaluation of the program a cooperative and 
continuing process* Although we recognize that there are (ther aspects involved 
in evaluation^ we shall concentrate on behavioral objectivesj an area idilGh has 
received a great deal of attention esx)ecidly in the last three or four years* 



II* Formulating Objectives 

When setting up instructional objectives the teacher must first of all 
oonsider the performance level of the students rather than use standards based 
solely on the teadier*8 own educational background and ^cperience* The interests 
and learning ability of the student nust be taken into consideration^ as well as 
the amount of instructional time available in idiich tc accomplish the objectives* 
First, however, let us distinguish between an op^ational objective a pro- 
cedural statement* An operational objective states idiat change is to take place 
in the behavior of the learner as the result of instruction* It purports to 
tell woat the learner is able to do at the end of a period of instruction^— 4 diether 
short or long— that he was not able to do at the beginning of instructiah* A 
procedural statement is not really an objective but a declaration of what content 
the teacher intends to use to bring about this (bange* It is frequently a state- 
ment of teacher activity sucb as ire find in the follpiving examples taken from a 
recent, commercially published level one teaching guide and idiicb appear at "ttie 
beginning of each unit* 

1* To teach the negative form of vexbe learned in previous units 
2* To teach tlxe vae of cardinal nunbers before a noun 
3« To teach understanding of questions intrcxluced by conbien 
4 «' To Introduce concept of the possessive adjectives jna* " ta * 

Therefore, statements such as "to teach the subjective," "to expl^ the differ- 
ence between parce c^e and ^ clause de^" "to give pattern practice < 3 n §bre in the 
present tense’^ do not indicate Viha^ change is to take place in the learner but 
rather ihat the teacher intends to do in carder to bring about this change* 
Objectives which are stated in behavioral terms facilitate evaluation because 
they specsify activity ihich is observable and measurable* For examples "When 
given a mcxlel sentenc^e orally in French containing a noun mcxiifled by a i>ossessive 
adjective and an oral cue taken from a list of notrns, the student recite 
the sentence making the appropriate correlation in li out of 5 items*" Objectives 
of this type specifjr ihat ths learner must deraonstrate to show that he has achieved 
the objective* 

M i nim ; Uy acceptable levels of student perfonnance should also be specdXied 
before instruction takes place so that the learner will knoxr in advance what level 
FR?r ^ performance are expected when he is evaluated* Setting 

Eiix I Li: standards in advance also helps guide the instructor in determlng if the instruc- 
L t1nn has been furceaaftil* — . ■ ■ 




Ill writing objectives Mager (1962:12) suggests the foUowlng steps: 

0- 

Firsts identify the terndnal b^iavior by nans; 
we can specify tlie kind of behavior whidi will 
be accepted as evidence that the leamer has 
achieved the cbjective* 

Secondj txy to further define the desired behavior 
by describing the inportant conditions under which 
the behavior will be esq>ected to occur. 

Thirdj sfpecify the criteria of acceptable perfosw 
nance by describing hoir i#ell the learner nust 
perfom to be considered acceptable. 

In the foUowing this procedure we can identify three eZenents of an objective: 
terminal behavioTj condition, and criteria. However, only the first two elanents 
are essential to behaviorally stated objectives. The criterion elenient as 
previously noted is highly desirable and indeed becomes necessary when grading 
scales for pupil performance az^e being considered. The purpose for writing 
objectives is to con&unicate intended educational outcomes. If the objective 
when written can be given to any conpetent person tiro is subsequently able to 
ijqplenent it and achieve the results desired, then the writer has succeeded in 
coBBounicating. 

Terndnal behavior should be stated in terms iMch are open to as few 
interpretations as possible. For exasple^ GRpressions such as to write, to recite, 
to read aloud, to identify, to solve, to construct, to say, to list, to compare, 
and to move are all ertemallzf d actions and can therefore be observed and 
KsasuiTed. ' On the other hand, activities such as to knoir, to understand, to ' 
appreciate, to enjoy, to believe, to comprehend, to listen, to read, to hear, 
take place internally and are thereforo observ^le only when th^ become eocteiv 
naliaed. (Krathwohl, l$6Ut 101-175) 

The second element, the condition, helps to further define the type of 
behavior sou^t by stiimlating the situation or stimulus under which the learner 
is required to perform. The condition can vary depending upon the the level of 
specificity and scope of the taminal behavior sought. For instance we might 
pose the condition: Given axy oral declarative statement in the present tense 
and the introducer, il f^t que, the student will recite ‘tiie transformation using 
the subjunctive fom of ihe vcub. This Involves working with only one type of 
fltdmulus, U fait que, but at a broader level we mi^t wish the condition to 
ecctend to any^ntroducer iMch requires the use of the subjunctive. On a still 
broader scope, and once the subjunctive fom has been practiced, the pupil^s 
knowledge of usage can be tested by random cueing with various Introducers some 
of iliich require Vrie subjunctive and others of liiich require the indicative. This 
last objective, it should be noted, presupposes knowledge on the part of the 
learner of the conditions governing the choice of mood when such introducers are 
used. It is necessazy and helpful for the teacher to make sure that these pre- 
conditions of learning are met. (Gagne, 1965:2$) 

The third characteristic of a clearly stated objective is the criterion 
i4iidi can be stated by the tise of some of the following terns: a T>rfrrfninm period 

of tine for perfoimance, a minlinum number ^ successful items, percentage, or a 
mlnlwuin acceptable deviation from some standard. Althougb tbe level of perfor— ' 
mance sueli as **eigbt out of ten correct answers will be acceptable for passing", 

Q is one criterion for measuring the success of a pupil in a given task, the more 
ERIC 
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fimdamental queation of "correctness" requires a different set of neasures* 

These measures must he spelled out uhen terss such as "acceptable”^ "appropriate"^ 
"proper," and "adequate" are used in. formulating the objective* 



HI. Eacacples of Behavioral Objectives 

Useful objectives raist state uhat ^e learner will be able to do uhen he 
has successfully coo^leted a leaxiiing experience* Because the tasks cf leaimng 
are dependent upon the acquisition of prior capabilities, ire must consider objec- 
tives in terns of imnediate as irell as long range goals* Both types may be speci* 
fied* In a foreign language program ire are conceraed basically vith the skills 
of sound discrimination, listening comprehension, sound production in context, 
correlation ck sounds uith graphic synbols, comprehension of graphic symbols in 
cantest, and reproducing graphic symbols in C(»iteid> vhen given the sounds thay* 
represent* These activities are frequently lumped together under the headings 
of listening, speaking, reading, and vriting; but a little reflection idll reveal 
the desirability for greater precision In specil^rihg the b^avior sou^t, particu- 
larly ehen ire vish to test for the acquisition of the skills involved* Conse- 
quently, our objectives must be directed toward specific skills* The long range 
objective may express the goal of a week's work, or it may aim at expected attain- 
ment at the close of the unit, the semester, or the cong^ted foreign language 
level* For example, a semest^ goal nay be: "Students will, correctly manipulate 
the farms of any -er verb in *^6 present tense," The skill of manipulation could 
involve oral or mdtten activities, and the subject stimulus might be given oirally 
or in written form* TherefGa:^, all of the prerequisite skills which the student 
must acquire before he is able to manipulate any verb must be analysed, 
IdeTitified and specified in short-range behavioral objectives* Long-range goals 
are termed general objectives, whereas short-range immediate goals are referred 
to as specific objectives* 

Up<ai analyzing the general objective stated above, we find thah the 
student must be able to manipulate particuljj? -ar verbs before he can be expected 
to generalize his skill to any -ar ver^u thierdPOTe, ire xoi^t f onaulete the 
foHowiiig objective for attainment over a shorter period of time: "Given \ 

subject pronoun orally, the student will recite the appropriate foxns of tne vexbs 
habl^* to rnar* and Hamar * Correct responses to 9 or the 12 cues will be passing, 
and the class idll pass," Ksre we see the elements tiiat are contained in 

a behavioral objective* First, a condition or situation is expressed in teims 
of the stimulus "given a subject pronoun orally*" Next, the behavior or action, 
describing idiat the learner will do to demonstrate his skill, is stated: "the 

student will manipulate correctly the forms of the verbZ hablar, ton^, and 
Hamar *" The final portion of the objective, although not a required element 
in the statement, is the criterion, or idiat ifill be the acceptable minimal level 
of achievement or perfatmance for passing*" An additional (Pterion "and 
of the class will piss" states idiat percentage of the group is eocpected to achieve 
the artnlmal acceptable behavior in order to consider that the objective has been 
acccn^llshed* 

Since wc are interested in performance of certain skills, the following 
examples will pertain to those foreign language skilln commonly developed at &e 
beginning levels* 

Sound discriinlnation * After hearing a series of word pairs, one of which contains 
a fricative ^ the student will circle on his answer sheet the letter A or B to 
indicate perception of the fricative d; twenty-one out of twenty«^ive items will 
be considered passing* ~ 



Attral coBprehensiCTU Given a picture and an aial statement in Germanj the 
student n^ks 3a"cr ndn to Indicate whether ca: not the statement fits the 
picture. Twelve i.mt of 15 items should be answered carrect]ly for a passing 
grade. 

Propunciation and intcmation . Given a kcgr word orally in SpanLab, the student 
will say the coii^lete i^aLsic sentence f^cm the dialogue with aiccept^le pronunci- 
ation and Intonation. Acceptable means unambiguous to a native speaker as Judged 
hy the teacher. 

Reading ccnBarehensicn . Given a paper containing the basic dialogue sentences 
and twelve numbered drawings^ the student will match sentences with the drawings 
and win be successful if he correctly matdies 9 of the 12 tested items. 

Writing . When given the first word of a sentence Indicated within a 30-eecond 
pause which will foUcw each cue. Acceptable perfarmance will be the completion 
of 8 of the 10 sentences with an average Ou. only one error for eadi sentence. 
Reading and writing. Given tifenly printed sentences in French with a new word 
to be sr^iituted in each^ the pupil rewrites them with the correct graiaaatical 
correlation. Fourteen correet correlatlQns will be considered parsing. 
Communication . (AbiU.ty to elicit and/or give infomation in response to an oral 
or visual stimulus*)' Givsh ary question selected frm. the basic dialogue sentences 
of units 1 throu^ 6, the student will respond with infannation sq>propriate to 
his personal eccperience. Thus a' student will; ' 

a. Respond to a greeting, give his name, introduce a friend, 
talk of his fandiy composition and ag», t^ where he lives, 
and tell of his general activities at given times of day. 

Out of a total of 18 questions (three per unit) the student 
should respond appropriately to lU for ndnimal level achieve- 
ment. 

b. When cued by an instruction either oral or written, in Spanish ' 
or English, or by a drawing, initiate comounicatlon In greetings, 
ask names, ask sl>oat a frie^, his identity or state of health, 
ask about family conpositions and ages, ask where anothex*^ person 
(either second or third) lives, ask about daily routine with 

reference to time of day. Out of a total of 18 items (three 
per unit) the student should respond appropriately to lU for 
irin-inifll achievement. 



IV. Providing Learning Opportunities 

Cnee the objectives for the course are decided, the teacher must set 
about planning strategies or activities for enabling the students to achieve the 
predetermined slcills. Ideally, preassessment of the ability of the class should 
precede formal instruction in order to find out whether members of the class 
alreac^' possess the sldLUs specified in the objective. In foreign language 
classes, particularly at the outset of the first year, students generally appear 
with ho previous eocperience) therefore preassessment may be done by aptitude 
tests. In later classes, diagnostic or achievement tests can be given for this 
purpose. The next step aftar preassessment is to select the learning opportuni- 
ties or activities whereby the students will work toiTard developing the desired 
sldHs. The oulminatlon of this ihase is usually in the form of a test to 
discover whether the objectives have been met. Should the test reveal that the 
criteria have not been reached, then the objectives and strategies are subject 
to revision and reapr)llcation. Ho^/ever, we frequently find that ijsstructlon 
falls idien it is not guided by certain principles or factors of learning. 
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learning ^tiylties should be based upon the folloHing five learning 
^indiOee ^ suggested ly Popham (1^5: 1^0): appropriate practice. SSividual 
oj^eren^tion^ perceived purpose^ graduated sequence, and knowledge of results* 
raese prtncipiles are derived frm current theories of the psycholo^ of 
4 brougjit to li£^t throu^ research on prograiBBed Instruction* FoUoidng 

is a brief esqplanation of each principle with an €Kanq>le which shovs its appli«* 
cation# 



1« Appropriate lyactice 

must be given the opportunity to practice the type of b^vior 
specified In the objective* Practice tthould be as close as possible to the 
cbjectlve in order for behavior'll cnanges to be accomplished* 

^?^wipTes Mr* Alvar*ez takes his Spanish class to the lab three times a 
week to give them pattern drill practice on material already introduced in class^ 
The patoem drill will subsequently be used as the basis for an oral quiz. 

2* Individual differentiation 

4 . 4 sbomd be geared to the interests, abilities, or achievement 

^individual students, thus taking Into consideration the student*s learning 
^ revealed by guidance records* Successful teaching can be acccm- 
juished to the d^pree that this principle is used* 



£xan|0.e: Mr* Heinz gives a preassessment test during the first week of 
sdiool to a class of lev^ H German students and finds that they have a' wide 
r^ge of achxevemart* He decides to divide them into three grouis-rfast. average, 
and slo»M.in order to prcu.^i^e for Individual differences* However, he gives 
eachipoup a German name and is careful not to make any referencesas to their 
Rouping* He bases assignments and c2Lass work on the capabilities of each grotm* 
He also mates a pracUce of calling on the bri^ter students first to give the 
sl^w students an opportunity to hear the correct response before cn 



3« Perceived purpose 

If students can be led to see the value of studying a foreign language, 
their chances of learning and continued pursuit of the subject are greatly 

Iz^roved., The teacher diould strive to find effective ways of ccnmninicatlng 
such values to the students. 



^cample: Miss La France majored In French and after graduating from 
coUege beca^ an airline hostess with Pan American Airways on the Mew York to 
Fans rm. She later became a teacher* She fi:eqwntly tells her classes of 
eocpenmc^ she had There her knowledge of French was vital for conmunication ou 

° tells them of other career possibilities There the study of 
a foreign language is essential or at least an asset. 

b* Graduated sequence 

4 .U 1 The Teauming sequence* should always proceed from the sis^ to the ccnplar, 
the to the unknown, the e^erienced to ttie nonexperienced, thus requirliK 
a gradu^ increase of effort on the part of the student* The pace of increase 
jflTi cc^lstent with the leamer*s ability. Teaching units should be paced 
^Ih fast and sl<zr, passive and active,* and steady and lntend.ttent activities 
to maintain the Interest of the student. 



Esan^lB! Ih presenting dialogue sentences, backward buildup is an exanrole 
of graduated sequence, proceeding from a small element to the whole sentenceT^ 




^CT/ledge of results 

siioulxi let the studexi't knoif a.s soon as possible whether he is 
ri^t or KTODg regardless of the type of test given* 

Example: The Russian teacher has given a jnnltiple choice test to check 
reading cc^ogjrehensiQn of tho dsy*s assignnents* He asks the students to check 
their ohk work in class and goes over the correct responses with them* 

It should be noted that t2ie above stated principles or factors are hy no 
means the only ones \iiich may guide the teacherts actlvily* Others will be 
mentioned in the section on evaluation* 



V* Evaluation 

The next question to be taken up concerns the measures a nd |i»pap « -to 
used in detendiring idiether or not the objectives have been reached, and ulti- 
mately whether or not the program has been successAil* In other words, we must 
consider the problem of evaluation; how do we dudge liiether the interaction 
among teacher, student, and materials has been productive and successful? Tn 
our classrooBi visits, \diat do we look for in this interaction ‘Hhich will enable 
us to conclude that a prc^ram is viable or not? We shalX try to discuss some 
ways in which these questions may be answered* 

jfivaluation occurs with the full hnoifledge of the teacher as to the criteria 
ty which we judge the effectiveness of a program, since they are-for the most 
part-explicitly stated in the objectives themselves. The objectives have pre- 
viously been agreed upon ty both the supervisor and the teacher. Defining objec- 
tives, idiether long or ^ort— range, facilitates communi^tion about instruction; 
and objectives stated b^vioraUy provide the kind of test the student will be 
required to perfom in order to show that he has acquired a skill* The teacher 
evaluates his students in several ways, seme of Tdiich will noif be considered* 

Ih foreign language classes we generally find three *^ypes of measurement 
procedures which the teacher' uses for gathering evidence about the effectiveness 
of an instructional strategy, that is, whether or not a giv^ skill was acquired 
by “ttie student as a result of class instruction* One type is a pencil— paper 
objective test, usually graded by a key. This is the most Camcn, perhaps, 
e^ciaUy in the beginning stages of language leaming which deal with skills 
of cognition (Bloom, 1956). Examples of such tests for the skills other than 
spiking are abundant In many of those tests idiidi accooqpany the current new-key 
materials. In addition, the excellent volume by Rebecca Valletta (196?) incor- 
porates recent findings from the psychology of leaming and testing* 

^ A second means for detezmining the acceptability of pupil responses is a 
type of check list of crii^ria for pupil psrfomiances* Su(^ perfozmance involves 
the activity itself rather iAiaxi a t^gible product* For exanqple, tdie objective 
awy require the use of certain gestures coniaon to the culture of the target 
language, A check list would contain notations regarding the types of gestures 
their manner of execution, A test of oral reading may involve a dieck list 
of aUophonio variations idilch depend upon vowel— consonant environments* 

For the later stages of language learning particularly, a third lype of 
cheek list can be used for evaluating ihe product of the learner* This is 
particularly useful for essays and ccuqposition whether oral cr written. 



Tr evaluating an entire program, however, the supervisor is interested 
not only in how well the students perfom on tests, but also In the nature and 
quality of the teacher activity. Of course, in hi^ acliievenent classes we 
recognize that problems of instruction generaliy are kept to a adnijmsni but in 
classes of average to low achievement, we arc interested in analyzing the activi- 
ties cf the teacher in order to raise the achievement level. The leaming 
principles mentioned in Part I\T of this paper can serve as some of the criteria 
factors to describe the teacher* s instructional procedures at all levels. Each of 
the following factors is listed with examples of kinds of evidence that might 
be given to substantiate its use. Note that although the factor may refer to a 
teaching activity, the evidence for its effectiveness is drawn from r .?pil perfor- 
mance. 



Evidence that Factor is Used 



Number of opportunities students have to 

1) practice writing before, a dictation 
test 

2) recite individual dialog lines before 
being tested 

3) practice the same kind of responses 
that will be required when tested 

B, Reinforcement (reward) Frequency with xdiich students are 

encouraged or comidimentci by the 
teacher idien they respe^ well 
orally (Note; there is some evident 
to indicate that intermittent praise 
is of more value than constant praise*) 
Number and of conments written 

on returned papers to encourage 
students 

Aliy indications that the teacher has 
secured information concerning idiat 
sort of a teadier-response individual 
students consider to be a reward* 

C* Individualization Frequency with idiich strong d students 

are called on to initiate individual 
oral recitation of new concepts before 
wealcer students are asked to recite 
with a longer opportiniity to listen 
Frequency with which stronger students 
are called on to recite dialog sentences 
before weaker students are called cn 
Evidence of continued reseating of studentt- 
to provide Tnflyjimim learning opportunities 
for weakest students; they may be placed 
in ffont of strong students or placed 
where teacher can call on them more 
frequently, or placed where thqy can 
hear and see best, etc* 

D. ContirmUy and re-entiy Number of consecutive days ttiat a new 

concept is drilled before skipping 
a day 



Factor 

A* Appropriate practice 



NuntiT of appropriate re-entries of 
concepts throughout the entire 
semester so that students liandle 
the concept best at the end of the 
semester 

Kustbcr of re-entries of a neir concept 
duiine tlie first hour that it is 
presented with appropriate "rest" 
periods betveen each re-entxsr 
(Each of these kinds of evidence is 
available ft'om the lessen plans.) 

E. Graduated sequence Number of lessons that provide sudi 

seq[uential presentations as from 
the simple to the complex^ the 
concrete to the abstractj the 
knoun to the unknown^ the exper- 
ienced to the non-e:q>erienced, 
repetition to manipulation to 
communication 

Frequency with >ihich a confirmation 
of a student response to oral drills 
is provided 

Frequency irith which teadier provides 
an immediate check for students on 
a problem-by-problem basis diulng 
written work in class 
Number of homework assignments 
given with provisions for students 
to dieck iiie correctness of their 
responses immediately 

G, Correction Consistency with idiich students liio 

either make errors or are unable to 
respond in oral recitation are given 
opportunity to perform correctly 
after hearing a correct response 
Consistency with which teacher pro- 
vides opportunity to practice correct 
responses to counteract negative 
learning due to incorrect responses 

It is realized that the above factors do not represent an esdhaustive list, 
nor are the types of evidence Intended to be limited to those listed* The factors 
are based on cuiTent theories on the psychology of leandng, and the evidence is 
observable and measureable in any foreign language classroom. 

The steps involved in the type of cooperative eveiluatlcMi we suggest^ 
whether with one teacher or a group of teachers^ can be summarized as foll^Tws: 

1* Agreement on the general content of the course to be covered in a 
specified length of time. Examples? 

a; Situational: greetings, names. Units I-VI. ' 

b* Grammatical points: Itre, ayqiri ser. estar* haber; seln. haben; 
declarative and interrogative forms. 



F. Kioirledge of correctness 
of response 
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2, Agreeraent on the outline of content in the sequence in riiich it is 
to be taught. This is frequently detmiined by the course of stuc^y and the text, 

3« Agreement on objectives specified in tenns of pupil bdiavior. These 
are tentative and subject to revision as the situation msy dictate, but an 
initial c onttaLttsient is proposed to shoir idiat pupils must accopplish so that the 
teacher nay be rated acca^dingjyc 

A^eecieat on the principles governing the of evidence collected 

to desc^be instructioiial procedures. The principles already suggested, thjit is, 
appropriate practice, perceived purpose, individual differentiation, graduated 
sequence, and iimediate knowledge of results are intended to direct attention 
to factual-»<is opposed to inf er ent?.al— obs ervation in the classroonu Ary 
principle or theoretical framework can be used if it enables the teacher to ' 
change specific aspects of instruction in order to Inqjrove pipil perfcimance. 

We have tried to present a different approach to the prcfblem of assessing 
a foreign language program by specifying the consequences sou^t fron instruction^ 
This involved an identificati.on of the changes to take place in the lecrner^s 
b'ihavior, the conditicxis under which the learner is e:q)ected to demonstrate Mg 
competence, ano. the lowest Hunts of acceptable performance on the part of the 
learner, Ne^zt the instructional act itself involved a consideration of the 
actual observable activities cxscurring in the classroom. Then foHowed a suamiary 
of the kinds of evidence available to show the degree to idiich the desired results 
were obtained in terms of learner perfoormance and learner product. Finally, we 
provided a list of experimental variables which may be used in establishing 
hypotheses for the improvement of instruction. That is to say, if the objeextives 
are not achieved, we can analyze the factors listed above to detemine idiether 
a change in the evidence will bring about a (^responding positive change in the 
perfoormance of Ihe learner. Such anailysis serves to point vp the clynamlc cpiaHty 
of this iype of evaluative proc^ess. The objectives are not rigid, •tnfiflrri'hift 
rules and tools. Th^ are subject to revision should the hypotheses about 
inst^ctional procedures derived from pupil performance warrant such a change. 
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